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ABSTRACT ^ investigation was made of the job proficiency of 

the graduates of an experimental job-oriented graining J r S r J! a j° r 
Electronics Technician (X-ET) . Thxs^ program was designed to train 
lower-aptitude personnel in a relatively s or e ?“ _ - c- X-ET* s 

duties in the fleet. The fleet Performance s) 51 

, mstr-t^d samole of 43 Class A School graduates (A et sj were 
a^spqsed bv performance ratings and structured interviews with the 
tSItaiSans- supervisors after the technicians had experienced 

approximately a^oothe duty in the fleet. t„o groups _ were rated 
comparable in overall technical performance, but the A ET^s 
rated as more capable in the specific areas of electronics 
troubleshooting and in the use of test equipment. The A-ET-s tended 

to be in higher paygrades than the X ' BT '?' ^ he a ^ P at least 

career intentions for both groups were highly similar, and at least 
70 percent of both samples had completed one or more electronic 
training courses beyond their original ET training. Generally, the 
experimental ET program successfully trained 

oersonnel, in a relatively shorter period of time, to perform 
satisfactorily the duties of the Electronics Technician rating. 
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SUMMARY AND CONCLUSIONS 



Problem 

Follow-up evaluations were needed to determine the overall 
effectiveness of an experimental course designed to train 
marginally qualified personnel to serve as Electronics Tech- 
nicians in the fleet. The present investigation provides a 
final fleet assessment of the job proficiency of the experi- 
mental course graduates (X-ET'sj, in comparison with the 
proficiency of concurrently trained A School gi'aduates (A-ET's), 
after all technicians had served in the fleet for approximately 
24 months. 

Background and Requirements 

A job-oriented experimental course for training Electronics 
Technicians was conducted by the Navy Training Research 
Laboratory, San Diego, 1964-66. The orientation, development, 
and implementation of this training program were described in 
a previous technical bulletin (1) , The assessment information 
obtained from an initial fleet follow-up of graduates, after 
six months of fleet service, was presented in references (2) 
and (3) . The present investigation was needed to provide a 
fleet evaluation of the overall effectiveness of the X-ET's 
and the comparison group of A-ET's, after all technicians had 
served about two years in the fleet. 

Approach 

The fleet performance capabilities of 54 X-ET's, assigned to 
destroyers in the Cruiser-Destroyer Force, Pacific Fleet, 
and a matched shipboard sample of 51 A-ET's, were assessed by 
performance ratings and structured interviews. A training 
evaluation team obtained the performance ratings from supervisors 
during interviews conducted aboard ship after the technicians 
had completed about two years of fleet service. 

Findings and Conclusions 

Since research limitations prevented the administration of 
performance tests in the final evaluation, the following summary 
statements are made on the basis of the supervisors' ratings. 

After two years of fleet service, the X-ET's were rated by their 
supervisors as being similar in overall technical performance to 
the matched sample of conventionally trained technicians. However 
the A-ET's were rated as being more capable in the specific areas 
of electronics troubleshooting and in the use of test equipment. 

It should be noted that the lowest mean rating assigned to the 
X-HT sample was within the descriptive rating category comprising 
"average" performance. Although at least 69% of both samples 

;S 



completed one or more courses beyond their original ET training 
and the expressed career intentions for both samples were highly 
similar^^he A-ET's tended to be in higher paygrades than the 
X-ET's. " Generally, the experimental ET program successfully 
trained marginally qualified personnel, in a relatively shorter 
period of time, to perform satisfactorily the duties of the 
Electronics Technician rating. 
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A PERFORMANCE -ORIENTED ELECTRONICS TECHNICIAN TRAINING PROGRAM 



V. Final Fleet Follow-up Evaluation of Graduates 

A, Introduction 

An experimental program for training Navy Electronics Technicians 
was conducted by the Navy Training Research Laboratory, San Diego, 
1964-66. The experimental Electronics Technician (X-ET) course 
differed from concurrent Navy Class A Electronics Technician (A-ET) 
Schools in that course content maximized practical wox“k with stan- 
dard Navy electronic equipment and minimized the mathematics and 
electronic theory content to that which was directly related to 
job performance. Student input into the school consisted of Navy 
recruits with aptitude levels, in terms of Basic Test Battery 
scores, below the selection requirements for regular Class A ET 
schools. In addition, allotted training time for the experimental 
course was substantially shorter than for concurrent Class A ET 
classes. A detailed description of the development and implemen- 
tation of the X-ET course was presented in a previously published 
technical bulletin (JJ , 

Following completion of the training course, graduates of the 
five X-ET classes were assigned to destroyers in the C r u iser-Destro ye r 
Force, Pacific Fleet, An initial fleet follow-up performance evalua- 
tion was conducted after the technicians had served six months on 
board ship. Results of the initial evaluation, presented in earlier 
reports (2, 3), indicated that the X-ET f s generally were performing 
satisfactoriTy in the fleet. Although supervisors' rankings and 
theory test scores favored the A-ET sample, the X-ET f s were judged 
at least comparable on other rating assessments and performed somewhat 
better than the A=ET f s on practical performance tests. 

The present report describes the fleet performance of the 
technicians as determined by a final follow-up evaluation conducted 
after all X-ET’s had served approximately two years aboard ship, 

B - Methodology 

The initial six-months follow-up evaluation was designed to 
determine the effectiveness of the experimental course in training 
Electronics Technicians to perform their job in the fleet. The 
fleet performance of the X-ET f s was compared with the performance 
of a sample of conventionally trained technicians , since valid 
absolute scales of technical proficiency are not readily available. 
Despite efforts to match the two groups of technicians on the basis 
of length of time in the fleet, sampling restrictions resulted in 
the A-ET group having, on the average, one month more shipboard duty 
than the X-ET f s. The disparity between ET groups, in amount of time 
available for performance of technical duties, was also increased 
due to inequitable shipboard assignments to non-technical duties. 
During the six month interval prior to the initial evaluation, each 



technician spent from one to five months assigned to non-techni cal 
tasks, with the X-ET ? s receiving significantly longer non-electronic 
oriented assignments than the A=ET ? s. 

In order to assess the practical long-term effects of the X-ET 
training program, the final follow-up evaluation was conducted after 
the ET ' s had experienced about two years of shipboard duty. By 
setting a two year interval prior to the final evaluation $ relatively 
severe constraints were imposed on the research project. The interval 
was .sufficiently long for normal transfer and discharge processes to 
occur prior to evaluation, hence, approximately half of the subjects 
were not personally available for interviews. The wide geographical 
distribution of subjects prevented the administration of actual 
performance tests, which require extensive equipment and facilities, 
thereby limiting the available sources for evaluation data* 

1 . Sub j ects 

The final follow-up evaluation involved two groups of subjects, 
the first group was composed of 54 experimentally trained Electronics 
Technicians (X-ET f s) comprising 79% of the 68 students evaluated in 
the initial assessment. The attrition of 14 X-ET's from the sample 
was mainly due to operational commitments of destroyers which prevented 
appropriate research contact. 

The second subject group originally consisted of 64 Class A 
school trained Electronics Technicians (A-ET T s) who were selected, 
at the time of the initial evaluation, as a comparison group, on the 
basis of having been assigned to the same destroyers as the X-ET 1 s 
and having served approximately similar amounts of time aboard 
ship. Attrition, due to operational commitments, eliminated 20% 
of the original 64 A-ET * s , resulting in the present sample of 51 
technicians providing data. 

2. Procedure 

The follow-up evaluation consisted of performance ratings 
obtained through shipboard contact with the supervisor of each 
subject technician, and when possible, with the ET himself* A 
technically qualified evaluation team conducted assessment interviews 
after the ET’s had completed approximately two years of fleet duty. 

Due to the transfer and early discharge of some of the technicians, 
data for approximately fifty percent of the subjects were collected 
after the technician was no longer aboard ship or in the Navy* 

Background information from the interviews included data 
regarding the ET f s current rate, expected date of discharge, 
extensions of obligated service time, and, if the man had already 
been discharged, whether he had been recommended for reenlistment. 
Training information included a listing of any additional schools 
attended since the ET had completed his initial ET training program* 




2 



11 



Data regarding future Navy and professional career plans were 
obtained from the available technicians. 

Performance evaluations were made by the supervisors regarding, 
the ET ' s ability to troubleshoot malfunctioning electronic equipment , 
the proficiency with which the ET used available electronic test 
equipment, and the ET ’ s overall technical performance ability. It 
should be noted that the performance evaluations were not actual 
performance tests, as administered in the initial follow-up, but were 
ratings of technical ability made by the technician’s supervisor. 
These performance estimates were determined by means of a five-point 
rating scale of performance descriptions, ranging from "inadequate 1 " 
to "excellent." Supplemental performance data included a listing 
by the supervisors of the different types of equipment that the 
ET maintained on a regular basis. Opportunity was provided the 
supervisor to note specific differences in job performance between 
ET 1 s . 

C , Results 

The results presented include data for the total graduate 
sample of five X-ET classes. Complete usable data were not available 
for all subjects due to transfers and early discharges, resulting 
in variations in the sample size across the assessment variables. 

1 * Sample Characteristics 

a. Transfers and discharges . Table 1 contains the number and 
percentage of ET ’ s in each sample who had been transferred or 
discharged from the Navy at the time of the final evaluation. 



TABLE 1 

Comparison of Number of ET ’ s Transferred or Discharged 



At Time off Evaluation 


X-ET’s (N=54) 


A-^T ’ s (N=5 1 ) 


ET T s remaining in sample 


23 (43%) 


12 (23%) 


ET T s discharged 


25 (46%) 


33 (65%) 


ET 1 s transferred 


6 (11%) 


6 (12%) 
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if 

The fact that a larger percentage of A-ET's (65%) than X-ET's (46%1 
had been discharged at the time of the final evaluation reflects 
the longer length of elapsed service time" for the A-ET's, which made 
them eligible for discharge at an earlier date than the X-ET subjects 

HriI ^- sted rate a- t time of evaluation . Distributions of 
the ET s enlisted rates, determined at the time of evaluation 
are presented in Table 2. The A-ET's, as a group tended to be 
significantly higher paygrades than the X-ET's (chi-square = 
o, is with df - 2, p <.01), Although the majority of both samples 
were third class petty officers (E-4) , only 12% of the X-ET?r 
compared to 33-s of the A-ET's, had advanced to the E-5 level 



The higher pay grades of the A-ET 1 



s are also reflected in the fact 



that while no A-ET is lower than E-4, 20% of the X-ET sample 
are either Seamen or Seamen Apprentice (E-2 or E-3) . The smaller 



TABLE 2 

Comparison of ET ' s Paygrade Levels 



Paygrade/Rate 


X-ET's (N=50) 


A-ET's (N=43) 


E-2/ Seaman Apprentice 


3 (6%) 


0 (0%) 


E-3/ Seaman 








7 (14%) 


0 (0%) 


E-4 /Third Class Petty Officer 


34 (68%) 


29 (67%) 


E -5/Second Class Petty Officer 


6 (12%) 


14 (33%) 



percentage of X-ET's at the higher E-5 level may be due, in part 
to the longer length of fleet service of the A-ET's, although 

Srobahf 3 ri tW ° ySarS ° £ £leSt duty ’ the iower X-ET pay grades 
probably reflect some difficulty experienced bv the X-ET's in passing 

advancement in rate examinations, which are typically theoretical & 
and mathematical in content. P y w.oreucal 



of ft J = f ° bl ifi ated service . The number and percents, 

of ET s who extended the length of their obligated service are 
shown for both samples in Table 3. A chi-squtre statistical test 

t2m Cat ? d n ? S1 ? nificant difference between the two groups in 
11113 of extensions of obligated service. (x? = . 39 , df = l 

p ^ * Ub j , 9 



TABLE 3 



Number of ET * s Extending Length of 
Obligated Service Time 





X-ET 


*s (N=50) 


A-ET' 


'5 (N=42) 


Did extend length o£ 
obligated service 


4 


(8%) 


2 


(5%) 


Did not extend length 
of obligated service 


46 


(92%) 


40 


(95%) i 



d. Recommenda tions for reenlistment . Table 4 shows, for 
both samples, the number and percentage of ET * s who were recommended 
by their supervisor for reenlistment. Recommendation for reenlist- 
ment is contingent upon acceptable job performance and satisfactory 
adjustment to Navy life on the part of the ET . The majority of 
ET 1 5 from both samples were recommended for reenlistment, A 
c hi - square statistical test indicated no significant differences 
between groups , in fact, over SO^ of both samples were recommended for 
reenlistment, (X^ » 2.16, df =* 1, p > • 03>. 



TABLE 4 

Number of ET’s Recommended for Reenlistment 





X-ET' 


1 s (N=47) 


A-ET'S (N-43) 


Number of ET ' s Recommended 
for Reenlistment 


39 


(83%) 


40 (93%) 


Number of ET ' s Not Recommended 
for Reenlistment 


8 


(17%) 


3 (7%) 




2 . 



Training 



The number o£ additional electronics training courses satis- 
factorily completed by each ET were recorded during the evaluation 
interviews. Frequency distributions of the number of courses the 
ET f s completed are included in Table 5 for both research samples. 
Although a chi-square test indicated that the distributions of the 
numbers of courses completed differed for the two groups * 

(X- - 30,02* df = 6, p < # 01), it is apparent from the table that the 
majority of both samples (at least 69%) did successfully complete one 
or more technical courses beyond their original ET training. 



TABLE 5 

Additional Training Courses Completed 



Number of Courses Completed 
Since Graduation from 
Initial ET School 


X-ET 


'5 (N=51) 


A-ET 


* s (N=43) 


0 


16 


(31%) 


7 


(17%) 


1 


IS 


(29%) 


22 


(51%) 


2 


13 


(26%) 


5 


(12%) 


3 


3 


(6%) 


4 


(9%) 


4 


3 


(6%) 


3 


(7%) 


5 


1 


(2%) 


1 


(2%) 


6 


0 


(0%) 


1 


(2%) 



A large part of the difference between groups stems from the 
fact that 31% of the X-ET f s and only 17% of the A-ET f s did not 
complete any additional courses beyond their original training, 

3 , Technical Performance Capabilities 

a. Equipment maintained by ET's * A list of the specific 
types of electronics equipment, generally maintained by each ET was 
obtained from the supervisors. Table 6 summarizes* for both samples* 
the equipment types generally maintained by ET’s in both the radar and 
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communication specialties. The distributing nt ct. . .. . 

P a rticu la r types of equipment are highly similar for^oth"^ 111111 ® 
xn the two equipment sreq<= r n ® ' . uar tor both ET groups 

the presence of a relatively small pe?«nS«e 'o?" U f P, " ent ■ s P ecialty ' 
sample having been cherl^rl L C P 7 rcenta p of ET s from either 
gear" reflects, in part the cnmna the ' portable communications 

equipment retained aboard a destloyer^Telet 11131 % ani ? Unt of P or table 
one type of gear for which th- A^E^rlc^' th ® 
tage of checks (17%) than the X-FT*s (2 m aotabl y lai^er percen- 

teletype equipment iypi^ally requires ttlnJ Maintenance of complex 
the X-ET sample did not receive during ^hS® Ini tC^t training which 

or during their shipboard duty. The f-ET and A pt * trainin S program 
on the average, 2.1 and 2.0 different types of^fl f^ 1 ® 5 maintained. 
The mean difference was not statistically signiaca^?" 10 6qUipment - 

.. b ‘ Performance ratines. The supervisors rated ^rt, PT 

el ec tr oni c^t est^inst rumen ts ® qu; f pment * ability to°u Se 

relative to similarly rated’me • overa41 technical performance 

Tho P erfor ma nc”iaU^s « re bLed on'r? 1 !*“. in the servi “' 

descriptive levels r*nLn!l ° f , 7 ? five-point scale with 

The distributions n f g from inadequate" to "excellent." 

for all three variables are^resent^”® 5 *^? si S ni£icance test results 
rated significantly higher than the ^ ET ' ab ^ e 7 * The A-ET's were 
in the use of test equSmLt Jiln ° n troubleshooting and 

difference between ET SouS’on 1 ^' thei ? Was no significant 
ability. While the x FT , P ©rail technical performance 

troubleshooting and us'e o? TTt Tut 'T their -P^isor* in 
to the practical performance test^esults ' r thXS * dlrect contrast 

follow-up technical bulletins A T lT re P orted in ^ initial 
the supervisors' ratines al e * bu *" -*- s in direct agreement with 

that the lowest mean ^oup^atLTfr^oV reportPd l « ^uld be notoS 
falls within that cat^ory of performancV d f by the X ' BT ^ple. 
"slightly above average" perfo?mlSr Seltn jCriP ? nS com P risi ng 
was rated below ’'average” on anvof th/ ^5 sample, as a group, 

ge on an X of the performance variables. 

4 - Career Intentions 

m tSf — «i«a 

already been discharged the r?? subjects from both samples had 
technicians remaining Aboard TTTT*™ th ° Se ex P re ^ed by the 
evaluation. Of the 24 X-ET's and 13 I°p?Tf &t , tim ® o£ the fina l 
only one X-ET and one A-ET indlcat^a A E T 3 available for interviews, 

the Navy beyond their curren^e^ ^Ustm^nt ^So^” ^ 

career intentinn^ ^uiieiit period. The electronics 

40% of botriamILs inlenlS f m P leS . were also similar. Almost 

electronics in Civilian life. C ° ntinue work ing in the field of 
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Technical Performance Ratings for ET Group: 
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3.72 



TABLE 8 



Technicians' Career Intentions 



Career Intentions 


X-ET 1 s 
N 


(N=24) 

%* 


A-ET 1 s 
N 


(N=13) 

%* 


Plan to remain 


in Navy 


i 


(4%) 


i 


(8%) 


Plan to leave 


Navy 


23 


(96%) 


12 


(92%) 


Totals 


24 


(100%) 


13 


(100%) 


Plan to work 


in electronics 


9 


(37%) 


5 


(38%) 


Plan to leave 

electronics field 


14 


(59%) 


6 


(46%) 


Undecided about 


career 


1 


(4%) 


2 


(16%) 


Totals 


24 


(100%) 


13 


(100%) 



Note . 

^Percentages are rounded to nearest whole number. 



D. Summary and Conclusions 

This investigation was designed to provide a final fleet assessment 
of the overall job proficiency of the graduates of an experimental 
ET training course conducted by the Navy Training Research Laboratory, 
San Diego, 1964-66, The total X-ET project represents a fairly 
unique and significant research effort. In this research an innovative 
training course, incorporating job-oriented training philosophy, 
methods, and objectives was developed, implemented, and objectively 
evaluated in a series of realistic assessments. The purpose of the 
course was to train input of marginally qualified personnel, in 
a shorter time period than concurrent A Schools, to be fully able 
to assume ET responsibilities in the fleet. Accordingly, both 
the training content and the achievement evaluations emphasized 
performance skills actually required on the job and minimized the 
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theoretical and mathematical knowledge not directly needed for 
i ob performance. The fleet assessment of X-ET's, described in this 
report, provides a final, but limited, appraisal of the overall effec 
tiveness of the experimental training course in meeting the training 
goals established for it. 

While the fleet evaluation involved assessments of the capa- 
bilities of 54 X-ET's and of a contemporary shipboard sample of 51 
A_et 1 s , the primary purpose was not to make direct comparisons of 
the proficiency of the X-ET's and A-ET's, but rather to determine, 
whether or not the X-ET's were performing satisfactorily in the 
fleet. In appraising the performance of the X-ET group, one should 
take into account the lower aptitude levels and the shorter initial 
training of the X-ET's relative to the A-ET's in the sample. It is 
assumed that with an overall length of fleet service of 24 months, 
prior to the final evaluation, any effect on technical performance, 
due to the original difference between samples in shipboard duty time, 
would have been minimized. 

The assessment information showed considerable variation in 
the proficiency ratings within each of the ET groups, as well 
as intra- individual variations with respect to the different 
aspects of ET job performance. However, based on the composite 
assessment data, the following summary statements may justifiably 
be made. 

(1) In general, the experimental ET program successfully 
trained marginally qualified personnel in a shorter period of 
time to perform satisfactorily in the fleet the duties of the 
Electronics Technician rating. 

(2) After 24 months shipboard duty, the X-ET's tended to 
be in lower paygrades than the A-ET's, with 20% of the X-ET's 

at the E-2 and E-3 levels, while no A-ET was lower than the E-4 
level. In the A-ET sample, 33% of the ET's were at the E-5 
level, and only 12% of the X-ET's were at that higher level. 

(3) Over 90% of the ET's in both samples did not intend 
to extend their current period of obligated service. In fact, 

at the time of the evaluation less than 7% of the combined sample 
had actually extended their obligated service time. 

(4) There was no significant difference between samples 
on the basis of the number of ET's who were recommended for 
reenlistment. Over 80% of the ET's in both samples were recommended 
by their supervisors for reenlistment. 

(5) At least 69% of both ET samples successfully completed one 
or more technical courses beyond their original ET training. 
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(6) There was no appreciable difference between samples 
on the types of equiprn ?nt which they generally maintained. 

Similar percentages of ET’s from both samples maintained the 
different pieces of equipment in both the radar and communications 

special ties , 

(7) The A-ET’s were rated by their supervisors as being 
significantly better in troubleshooting equipment and in using 
electronic test equipment than the X-ET's. It should be noted, 
however, that there was no significant difference between samples 
in an overall technical performance rating, and for all performance 
ratings both samples were rated as performing at least satisfactorily. 

(8) Approximately 40% of both ET samples intended to 
continue working in the electronics profession. 

In summary, the X-ET course was generally successful in 
training marginally qualified personnel to perform ET rating duties 
in the fleet at an acceptable level of competence. The job capa- 
bilities of X-ET*s were comparable to those of A-ET's in many respects, 
although they rated relatively lower on a few of the assessment 
criteria. It may be noted that some relevant performance criteria, 
such as shipboard assignments, rate of advancement, and supervisory 
evaluations, may be influenced to an undetermined degree by the 
unintentional bias of fleet personnel and fleet standards toward 
the theoretical, verbal, and mathematical capabilities more 
characteristic of the conventionally trained ET. 
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APPENDIX A 

Troubleshooting Performance Rating Scales 
Inadequate 2. Weak 3. Average 4. Good 5. Excellent 
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Inadequate 2. Weak 3. Average 4. Good 
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